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0 A method of passing task messages ma data prooesstng system. 



® Processor s 5. 7 comnumlcatively attached to a 
s to r age sul>'sy8tBffi 3 place task m easages for the 
8ut»yst8m on a queue. The processor s do not have 
to wait on a queiM lock set by another processor or 
sut>-systsm whilst dequeufrig a message. Ihis Is 
achieved by use of a double ended Rnfced fist or 



queue of messages having an tedatkvi/irsferenoe 
point wherein an entpjeidng end of Oie list is k)o- , 
kable and accewlMe Indepe n den t ly from the de- 
quetdng end of the Bst The locking pdmifive may be 
of the rmiftiivocessor took synchronizing . atomic 
type such as TEST AND SET. - 



CO 
€0 



9 



111 



!l ^^4. iL • 



niOCBSOR 

I 

? — 



mOCESSOR 



§ 



FROCESSR 
H 



SHARD. 
MEAtfL 
RMI 



OMia 



Hi 



ODSS 



I WOCESSOa ARBAT 



FIG. 1 



j 8ag\flt 



IRANSWrnR 



AMD 
PASnY 

uxac 



euHBt 




lOASD 
1 



BURSt 
JiND 
OK 



OAS) ARRAY 




Rank Xrac (UK) Budness Seivioes 



1 



EP0466339A2 



2 



ppkl of tho Invcntton 

This Invention relates to a method and means 
for passing messages t)6tween prooessoie having 
Older of magnitude speed differences to avoid the s 
rate of message exchange being dominated by the 
lower speed. Such message passing occurs be- 
tween concurrently executing CPU's and an exter- 
nal storage eub-eystem (e^. synchronous <firecl 
access storage device (DAiSD)arre^ lo 

Badsgrsund of the invention 

Contemporary high speed processing or super* 
computing oor^uras up prospect of 1000 mmion u 
instructions per second (MIPS) of coonfinate com- 
puting across multiple prxessor s aperlodicaOy re- 
forandng substantially slower specialized proces- 
sors such as dirsct access storage device (DASO) 
array controUerB. Sy n c hr on izat ion among proces- 20 
SOTS sffll requires a connbination of locks and mes- 
sages. Ijocks serve to bind resouroes to tasks wtto 
messages and ttieir prDcessing operate as ayn- 
cfaonfafe tg events. In contsmporBry systsms. task 
oriented messages ars enqueued' againsl re- 2s 
sources. Also, the queued access Is governed by a 
C^obaJ todc Thus, operations aro paced by the 

skmest processor obtaining tooted access to the 

queue. 

A stifle central prooesslr^ unit (CPU) or pro- : . so 
cesser typicatly includes a tocal operatino system 
(OS). RAM fanplenwnted intsmal memory, tocal 
instnictkm and^data caches operatively tamed 
from the internal memory, an extsmal stors. and . 
took, cache, and storage rssouroe managers. How- ss 
ever. Wgh speed or superoomputing involves ap- 
pecatkns execufing over several processors. The 
appGcafions initiate tasks in the form of OS Instnjo- 
tens (READAWUTE). These tasks are queued 
against the resources which process fl)em. In this 4o 
case, these era the general ar^j special purpose 
processors of the high speed system. The tasks 
era relatively synchronized (ordwed) with rasped 
to CBBh other ty fteir position placement as mes- 
sages in the queue in a commonly accessible 45 
portion of processor shared internal memory. 

The messages (tasks) are expressed as encap- 
sulated operations defined over a range of ad- 
drosses. Where the messages relato to accessing 
external storage, they are enqueued by processor s so 
in the stursd memory and await dequeuing and 
execution by the storage sub-system. Concurrently, 
messages Indicathre of tftsred or completed stor- 
age aooesa taste are also enquwed by the storage 
8ut>ey8tam in ttie shared memory and aw^ de- ss 
quet^ and eooecufion liy the processors. By lock- 
if^ th queue, the skmest processor such as the 
xlsmal store (array controller) can pace the entire 



ofwatlon. 

As mentioned at)ove. synchronlzatton Is 
achieved among prooessore and taste using 
queued access messages usually controlled by 
some form of tocMng. However, where there is a 
raw dispaifty in capacities, then much may go to 
wasto. while the faster processor awaito access to a 
queue cunentiy bound (kxkBd) to a substantially 
etower processor. 

Even where the processor eitga^ external 
DASO storage without delay, there may be a gross 
mismatch of data rates. IBustratively, conounent 
p r ooessore SNScuting 100 MIPS and a 100 
MBytes data transfer rate might have to commu- 
mcato wHh a gigabyte DASD having a 1 to 3 IMByto 
transfer rate and a 10 mUSsecond access tirne. 

Patterson et al. «A Case for ftodundant Anays 
of inexpensive Diste (RAID)", ACM SIQMOD Con- 
ference. Chkago llfinols. June 1-3. 1988 dscusses 
the general solution with respect to data rate 
matching bi the form of accessing N synchronized 
OASOs to paralleL Sjimchronous behavfor requires 
N DASDs to rotate at the same rpm. fiawa the 

same angular offset and be accessed In an Men- 
tical manner at the same time. 

.As an altemafive to communlcaGng data In 
parallel vta Pattereon's synchronized DASD*s, data 
rate mismatch has been managed by intertocte or 
tocicable buffers. Buffer size and cost have re* 
malned as obstactes.-.:.:^ 

Beausolea ^ at-iisP 3;338ff82. 'Interloctod 
Communication System*, issued August 15. 1967, 
shows an Intertocic over which a low speed proces- 
sor paces the transfer tom a Wgh speed proces- 
sor. That Is. a low speed processor such as a 
storage . ^ control mSl (IBM 3880) strobes a 
CPUfehannel (SOTO) over a demand response in- 
terface Incficating that it is available to process the 
next Information unit 

Cage. USP 4.454J505. 'Buffer For Use With A 
Fbced Disk Controlier^. issued 6/12^1984. dtedoses 
a multi-ported random access memoiy managed 
by address register manipulation as an asynctvo- 
nous paititioned circular buffer. Data is read from 
or written into consecutive RAM addresses on a 
partHion-at-a-time basis in wrap-around (cbcular) 
order. A partition/block consists of a fixed number 
of consecutive RAM addresses sized to hold a 
track sector of data, the MM buffer having a 
cepadtf of at least two such partitions. 

In Cage's buff».tfie speed of the movement of 
fbced btocte of data is matohed between the main 
m nrory (DMA) of a word p rocessor and an at- 
tached DASD. A DASD write or read command 
resutte in data being moved either from ttie DMA or 
a DASD track sector into a first RAM partitioa 
Because RAM operations are asynchronous, a de- 
mand transfer from a second RAM partition can be 
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overtapped wltti the flist movemant as an atomic 
part of the ootnmand (DASO read or witta) being 

Knifth. The Art of Computer Programming*, 
Second Edition, copyright Addison*WesSey Pub. 
Co. 106& 1973, Vol.1 Fundamental Algoifthms. 
pages 234-239, S31*534. describes a "deque* as a 
Bnear list !n which afl Insertions and deletions are 
made at the ends of the Qst He further defines an 
"input restricted deque" as a linear Dst in which 
Hems may be Inserted at one end and removed 
from the other end <8ec^1 EMordseiy. 

Dtedosuie of the invention 

The Invention prevldee a method of passing 
task messages In a data processing system bichid- 
ing a phxraOty of high-speed processor s , an exter- 
nal storoge subsystem, and shared internal mem- 
ory, said mettiod co mp risi n g «ie steps of: defining 
a first Bnkad Bst In the shared Internal memory wHh 
separately kxks^ first and second ends: and 
operating said Bst as a queue of task messages 
passbH) between the Mglhspeed processore and 
the atorsoe eiibsystam, loCWbly enqueuing task 
messages at the first end of me queue and ir>- 
dependently lockably dequeuing task messages 
from the second end of the queue. 

Pietaiably the method further comprises the 
eleps of denning a second Mood fist bi the shared 
tntemal memory wWi separately todcaUe first and 
second ends; and operating s^ second Bst as a 
queue of iBSk messages passing between the high- 
apeed piooe ss o re and flie storage subsystem, with 
to* messages being lodcsbly enqueued by the 
external storBge stdsystsm at the first end of the 
queue, and Independently task messages being 
tockaUy dequeued by tfw high speed processors 
from the second end of the queue. Correspond- 
ingly, on the first fist tesk messages are enqueued 
at sakl first end of fite queue by the Idgh-speed 
processor s , and deq u eued from the second end of 
the queue by the etdemai storage subsystem. 

ki a preferred emtiodlment, reference points 
and operator sets are defined ever sakl first and 
second fists, one reference point being assodatad 
wHh the second end of each iist, and each operator 
set including top of Qst (TOO) and bottom of Ost 
(BOQ) pointere, and top of Qst (TOOL) and bottom 
of Qst (BOCa) kxAwords. A first took Is obtained by 
one of ttie processors on said secocKf end of ttie 
first Qst upon said one processor matching th 
BOOL whereupon task messages are em bedded 
b o tw oon the referenc e point and ttie last message 
fai the Bst, and sM first lock Is released. A second 
lock can be obt ain ed by the subsystem on said 
first end of the first est upon said subsystem 
matching the TOOL, allowing one or more task 



messagee to be removed frtm said first Hsx before 
saM aeoond look Is released. Only the holder of 
sakl second tocfc (TOOL) may attar any pointer to 
the norHefersnoe end of the Dst or any of the task 

6 messages in the Bst, and only the holder of the first 
lock (BOQL) may alter any pointer designating the 
reference point end of the Bst 

It is also preferred that the processors originate 
task messages in the form of control blocks 

10 (DCB*8) for the subsystem, each DCB specifying 
one or more access operatkxie to tie executed by 
said subsystem, aald DCB^ being enqueued on 
the first fist by the origlnafing processors, and aaid 
subsystem dequetdng and process in g each JXB 

15 from add first Bst according to either an external 
disdpGne (MFO, RU>, FIFO) or eooonfing to a 
priority reordering of sakl first Bst or porttan fliera- 
of. Each DCB assumes either a waiting, active, or 
completed status, the waiting OCB's consfitufing 

20 the first Bst. active DCB's being cunently prt>- 
cessed. and completed DCB*a constituting the sec- 
ond BsL The subsystam then processes task mes- 
sages dequeued from said first fist updates each 
task message, and enqueues the updated task 

28 messages onto the second Bst said oritfnating 
processore dequeiAtg end processing each up- 
dated task message from sakl second Bst accord- 
ing to either an external discipBne (Uf=0, FILO, 
l=FO) or to a priority reordering of eaki second Bst 

so or porfion fliereof. 

The invention also provkies a data processing 
system bichiding a plurality of t^thspeed proces- 
sors, an external storage subsystem, end shared 
Internal memory, sakl system farther InchKfing: 

as means fdr defining fbst and second finked Qsts in 
the shared memory each with separately lockable 
first and second ends; means for operating sakl 
fifst and second fists as wait and complefion 
queues of task message s respectively, tockably 

40 enqueidng task messages at the first end Of e 
queue and Ind e pendently kxAably deqyedng task 
messages from the second end of fiie queue; 
means responsive to task messages ori^nafing ^ 
from processors for writing tite task messagss into 

46 the shared memory. BnUng sM task messages 
Into the w^ queue, and signaOing the storege 
sut)system accordingly; means at the storege stAh 
system aperiodically responsh^ to said signalling 
for dequeuing the task messages from the wart 

80 queue, ectively processing the dequeued task mes- 
sages, enqumilng the processed task messages 
onto the completion queue In said shared memory, 
and slgnafllng tiie processore eccordingty; and 
means apertodlcaDy responsive to the autnystem 

88 signals for dequeuing the p rocessed task mes- 
sages from ttie completion queue. 

Ihe above metttod and means permit process 
sore of disparate speed to have overlapped access 
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to either add or remove messages fai queued ac- 
cess (0osMon order processing) relaOon to each 
other. Thus processor s such as a CPU and an 
axtemal storage subsystem placing a message on 
a queue no longer have to waft on a queue lock set 
by another p rocessor or sukisystem dequeuing a 
message. A double ended linked Bst or queue of 
messages is used, prefer ab ly with an 
bolation/iPBfarence point (NULL/BLANK). An en- 
queuing end (rf the 6st (BOQ/BOQL) Is lockable 
and aooessible Independentty from the dequeing 
end of the Bst (nXVTOQg. TyplcaOy the method 
and means ufiOze simpie met»processor lode 
pHmffivee (In this regard, "meta-processor" de- 
notes available to all processorB). The lodcbig 
primitive may be of the multi-processor lock syn- 
chronMig atomic type such as TEST AND 
The processor obtains a tock. when available, be- 
fore inserting messages between the first end and 
the last message on the first ^^leue. and then 
releases the tock. Likewise the subsystem obtains 
a tocfc, when available, before kiser^ messages 
batwoen flie first end and ttie last message on the 
second queue. The avtitebflity of a tock can be 
tested by comparison matching BOQL wtth the 
tasuH from eNecuOng the tock primitive. 

Thus, in ottier words, task oriented messages 
can be passed between a ptura&ty of high speed 
processors and a relatively tow-speed external stor- 
age subsystem commurricalively coupled over a 
shared memory, using opposttaly poled queues. 
Rret and second dense finked inear 6sts ae de- 
fined in 9ie shmd memory, each Bst having ki- 
d^)endently tockabto first and second ends. A first 
tock to obtained l>y a processor on the first end of 
the first fet when avaaabte. the processor inseilfng 
messages between the first end and the bst mes- 
sage so Gnked. and retoasing saM first tock. The 
subsystem obtains another tock on the second end 
of the fbst fist wtien available, removing messages 
anywhere on the fist and retoasing sakf other lock. 
On the first and second ends of the second list the 
roles of the storage sut>-ystem and pr o cessor s are 
reversed. 

Brief Description of the Drawings 

Figure 1 shows a CPU/ DASD arrey data flow 
emphasizing shared internal memory, high perfor- 
mance channel Intorfto (HPO). anay controller. 
andOASD's. 

Rgures 2ArC respectivery depict a wait queue, 
an tttive Ost arKf a comptotton queue of DASD 

control btocfcs (PC8*S) setoctBbly tockabto at either 
end thereof. 

Figure 3 illustrates the enqueue opeialiuri on a 
IX^B waft and oomptotton queue. 

Figure 4A-B sets forth the dequeue operaltons 



on a respedhe first and second exampto of a DCB 
wait and oompletton queue. 

DetaHed Description 

6 

The preferred embodiment of this inventton 
uses a high speed multi-processor host interacting 
wHh a slower external store. The external store Is 
ilhistratively expressed as a synchronous anay of 

10 N DASD^ and an anr^ controitor. To enhance 
af^xedation of this fbmn of external storage, a brief 
descrtption of data organization on the anay 
(striping) and the use of informatton redundancy 
(parity blocks. ECC) to provided 

w Pttterson-s type 3 DASD anray synchronously 
reads and writes to N DASDs in column msjor 
order. However. N-1 of the DASD's contadn data 
and Che DASD contains a pari^ rsngbig over the 
other data OASOs. That to. one check DASD to 

so provided for the group. The contents of the failed 
DASD can be raoonstnictod in the manner of 
OucM. US Pat 4X)92.732. -System for Recovering 
Data Stored In a f^altod Memory Untt*. Issued May 
30. 1978. which disctoses the spreading of data 

25 btocks from the same togtoal fUe across a string of 
K- 1 DASD^ and rsconling a parity btock on the 
Nth DASD. The parity block to an XOBina af the 
parity contents of the N-1 other btocfcs. Contonto 
from any singto inaccess&to DASD can be recov^ 

so erad by XORing the parity btocks with the btocks 
stored on the N-2 remaning aocessibto DASD^a. A 
similar result can be achieved if the parity btocks 
arenotavaitebie. 

Typically In btock oriented data, a parity suffix 

as or equivatont (Hanuning. (»C) to appmtod to 
each data btock. Thus, each parity suffix cat be 
invoked to detectfeonoct Mra-btock enor. As de- 
scribed to OucH. when one or more of the btocks 
of an N-1 sequence are unavaOabto. a parity btock, 

40 which a priori spans the N-1 block sequence, to 
used in cor^iunctton with the remairdng btocks to 
rebufd the unavailabto data block. Efficient codes 
per se (Hamming. Cydto Redundancy Check. 
Raed-Sotomon) are elsewhere treated to the Gtera- 

45 ture. 

Refentng now to Figure 1, there to shown a 
system Including a an array of processors 1 cou- 
pOng as external storage a synchronous DASD 
array a The processors 5. 7, 8 are of the high 

60 perionfnance variety such that when operated con- 
currently they fiave processing speecto In the order 
orioo^f MIPS. A stower special purpose processor 
to the form of DASD anay 3 to coupled to array l 
by way of adapter IS. Other Intorrnatlon processing 

as souroesor8tok8SuchastocalarBanet«oricB.prtot- 
ers, or displays would Qoewtoe be coupled over 
counterpart adaptere 17. 

The fast and si w processor s oonununlcato 
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withlnarayl over a very Ngti speed bus 11 using 
a portion or shared bitemal RAM 13 as especial- 
toed rnesssge reposHory. Tto processors oorntilutB 
a <fistrfbulBd peer couf^ system wHh no central- 
ized operating system or process control. ATI re- 6 
sources such as internal ntemory 13. intennipl la- 
cmty. and global registers (not shown) are avallabie 
to any processor Including the external storage or 
0A8D anay subsystem (DAS) 3. 

DAS 3 preferably comprises a RAID3 type ro 
DASD enay and an assoc tet ed anay controller as 
described for SNBmple In the Psitemn rofermo^ 
and In the co^)ending Brady et sL a pp Oc a B on. EP 
01304S035, -METHOD AND MEANS FOR AC- 
CESSING DASD ARRAYS WITH TUNED DATA 16 
TnANSf=ER RATE AND CONCURRENCy". 
(AppQcartfs lOf . no. SAMMKS). Even thou^ DAS 
operates In a peer<oupled relationship ¥rith the 
other prooessoTB. It nevertheless queues task ori* 
ented messsges against ether processor s or re- so 
souicea. Any Change In the queue or other action 
raquasis such as halt cunent operafions are in- 
<ic8t8d by my of special purpose signals Oap 
signals). 

DAS receives tasks 88 messages and commu- 25 
rricatesthe results of task processing via control 
bkxks ananged in the forni or a decScated queue. 
This queue, as eMsm p lHied In Figure 2, lemabis In 
host 1 bitamal memory 13. The system includes a 
fadfity to reorder the queue according to changing so 
system pfforfSes. * ' 

Refsnfng again to Figure 1, there Vstiown an ^ 
array controller (elements 1M1) coupSng «ie host 
bus 11 by my of itonel adapter IS. TMs path 
provides access to aO system rssouroes Including ss 
memory 13, gtobal rsglsters, and tap signals on 
behalf of DAS 3. Adapter 15 preferably attaches 
OAS over a pair of simpIeK megabyte rsta receive 
and transmft interfaces 19. 21. The faiterfaoes. 
known also as High Perfannance PamDei interfaces 40 
(HiPPI). are described In the ANSI Draft Standard 
of 8^989. X3TB/88-127. Reviston This fadil- 
tates receipt of the so-called tap signals from the 
host and access to the host as InHlaied by DAS. 

Host or system fUncSonsavdlable for DAS use 45 
Include READ/WRITE internal menrnry 13. atomte 
TEST AND SET for lock operations in internal 
memory 13, atonUc operations on global registers, 
receipt and in terp r gtal i on of tap signals from other 
processors or system elements, and the generatfon so 
of tap signals to the system or host 

DAS 3 operates one addressable array of 
DASD*s 33. 35. 37 synchronized via sync circuit 39 
to each rotate at the same rpm. have the sam 
angular offM. and be eo oe ss e d In an Mentical ss 
ntamer at the same fime. This solufion mgrfmtoos 
data transfer rate. TMs permits high speed sequen- 
tial or skip sequenfial DASD data transfer. 



Data movement in the Host/DAS dlnaction 
starts tram Intsmal msmory 13 over bus 11 
through adapter 15, raoeiver 19. ending bi striping 
and parity to^ 2a Ijoc^ 23 Indudas the neces- 
sary digital and timing circuits to calcuiate a parity 
block t>y XOrVng the N-1 data bioclcs and transfer- 
ring countarpart biodcs to ones of the buffer and 
EOC dpcuits 27. 29. and 31. Each block is also 
protected by append an EOC byte thsrato for 
error dstecfion and correction on an intra-bkxk 
basis. Access to the N DASD^ Is n>ade synchro- 
nously in the convent io nal manner. The obverse 
obtains when data movement proceeds in the 
DAS/Host dfrecUon. 

The task or request is defined in a control 
block tanned a DASD Control Stock or DOB. A 
processor st the host bulkis a DAS DCS In internal 
memory 13. a then Dnics the DCS to a WAIT queue 
for DAS and signals the enqueuing operation. Sub- 
sequently. DAS moves the 008 onto the ACTIVE 
LIST, pedbrms DCS requested functions, updates 
the DCS and places it on the COMPLETION 
queue. After detecting the VO oompietksn. the host 
dequeues the updated DCS from the COMPLE- 
TION queue and a scert ai ns 9ie outcome of the 
DCS specHied operafion* 

Restated, a DAS 10 request is respongve to 
any processor 5^ bivoidng a READ^VRITE from 
its OS. A DCS Is btdit and plaoed on a WAIT 
queue tocated in intemal memory 13. A tap signal . 
Is then ssnt to DA& fat tum. the DAS Inspects ttie 
queue fbr «ie nsBd queued DCS using any one of a 
number of wodc management algortthms (FIFO. 
FILO. UFO etc.). DAS does not need to respond to 
the tap signal es a priortty event 

Refoning now to Figures 2ArC, the system is 
enanged such that the DAS "task WATT queues* 
are priority ordersd. A request may be retocated in 
the queue ralative to other tasks or DCB's at any 
time prior to its being made active by DAS. in 
this inventton. such reordering is a special functton 
of a DEQUE cperatton to be explained autise- 
quently. Note, that the DCB's remain at the same 
intemal memory 13 real address krespectlve of 
changes in queue Brddng prtorlty or acHveAMSiting 
status* 

One of the attributes of peer-coupled proces- 
sors is that the OAS is responsh^ to receipt either 
of a tap signal or its worfc managentent algorithm 
by finding the next queued DOB via reading an 
anchor pointer In Intemal memory 13 estabSshed 
during Mtiallzatkxi and changing the first waiting 
DC8 status from "WAITlng* to "active. This is 
accomplished by moving the DCS show in Figure 
2A to the ACTIVE UST per F^ura 2B. TWs Is 
broufliht about by the OAS executing a sequence of 
intemal msmory access operattons. Once the DCS 
is "active*, the DAS processes the DOB according 
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a (undkm code oontalnod in said DCa Relatedty. 
addTBss Inliofmatton h the 
data to be transferred. In this regaid, tho data 
transfer is oRadualad by DAS inHiatad o p aratio ns 
through the chamat adapter 15. 

ft should be appredated that each DC8 can 
assume one of three states, namely, "actl¥e". 
%rritino*. or 'completed*. 

When a data transfer operation is completed, 
the DAS writes completion status in the DCB, 
changes the 0C8 state as par Rgue 2B fnm 
*aclNe" to ^xmpieted", and enqueues the OCB 
n the associated completion queue per Hgure 2C. 
Also, the DAS may execute a number of OCB 
specified oompletjon notification prfmlfives. Signifh 
cantly, the transfer of data to and from internal 
memory 13 and the DAS la under DAS control. 

Refening stiQ to Rgures 2A<:, there are shorni 
several queues of DCB's. Each queue element 
geneiically called QEL, Is a contiguous s^ of 
words In a memory which both p ro cessor classes 
can feteh from and store to bn shared memory ia 
A QEL includes message words as wall as a Gnk 
p(Mer word required for queue!ng. Although each 
QEL could be a different length, advantageously a 
simpie system might use uniform sized QELs of. 
perhaps. 32 words each* TypicaRy, each shared 
memory word itseff consists of at least enough bit 
posiftons to contain the address of any other word. 
For example each word of shared memory could 
be64bil8iQno. 

A pointer to a CEL is the address of one of the 
wonte In the QB. (as used in this spedficalkm and 
f=igures 2ArC, the tenn •pointer- refers tither to an 
address, or to a place where such an address is 
found). Context detemiines wttfch is meant The 
word pobitod to, the Bnk pcAiter word, nomnafly 
contains fte address of another QEU tKrt can cor>- - 
tain a predetermined null value such as afl tto off, 
or an on. 

As iOustrated f=igure8 2AeC, a Blanlc<lEL is a 
QEL whose fink pointer word Is null Also, a queue 
may be formed from either a single Btank^lEL, or 
a set of Qas Gnked one to another by pointers 
leadng from a top QEL to a bottom QEL The latter 
is always a Kank-QEL when the bottom pcMer is 
untodced. 

Queues am lodced by using a mulfiprocessor . 
synchronizing lock operation avaflable to an partici- 
pating multfprooessor classes. An example is the 
classic Test and Set operatton whkii stores a took 
constant In a word of shared memory. If the pre- 
ceding fetch, whkii is part of the same atorrUc 
cper^on. returns a value other than this kxk con- 
stant then the Ted and Set operatton has suooase> 
fully tocked the tock word. 

A queue header oonslsto of four words in the 
shared memory as shown foflowing: 



TOQ Top of Queue Pointer: Shared mem- 
ory address of link pointer wort of the 
top QEL in ttie queue. 

BOQ Bottom of Queue Pointer. Shared 
s memory address of Qnk pointer word 

of the bottom QEL in the queue. 

TOQL TOQ Lock Word. For example a Test 
and Set tock word. Only the holder of 
tfte TOQ tock may after the TOQ 
w potnter or any of the contente of 

QEU Onked above the QEL pointed 
to by BOa <Noto that ttie BOQ pobrt- 
er may change whtte TOQ is tocked; 
see BOOL.) 

f 6 BOOL BOO Lock Word, Only the hokler of 
the BOQ tock may alter the contente 
or the QB. at the bottom of ttie 
quMe, possibly making It norhblank. 
Only the BOOL prooessorAiokSer may 
20 change ttie BOQ pointer vatoe. and 

ttien only if the new value is the ad- 
dress of a vaOd Blank-QEL 
Change ttie BOQ pointer moves ttie Isdatton 
point between ttie enqueuing and dequeuing pro- 
26 cesses. Once ttie BOQ to changed, ttie BOQ tock 
hoUer*s auttiorfty to update is reduced to ttie New- 
Blank-QEL and to ttie BOQ pointer. A TOQ tock 
hokler is always free to update any QELs down to, 
but not including, ttie QEL pointed to by ttie BOQ, 
so. whettier ttie BOQ is tocked or not 

Applying the above deflnlttons to Figures 2Ar6,'^ 
ttiere are shown oonstructe indtoative of ttie ttvee. 

states Into .which each DOB must be resolved Mt 
acttve, oomptoted)..*DCB*a dassified -as waHtog or 

35 oompletod are enqueued white an acfive.pCB te 
being processed, to each queue, each DCB has a 
pointer to ttie neod DCB to ttie chain. Ihe BOQ 
pointe to a nuD or blank DCB woperafive as ttie 
queue bottom white TOQ pointe to ttie most recent 

40 queueaddRton. 

Refentng now to Figure a, ttiere is delected an 
enqueue operation as ttie toading of a message 
into ttie Blank-QEL at the bottom of a queue, and 
ttie appending to ttie bottom of ttie queue of an 

46 additional QEL as ttie New-Btank-QEL The en- 
queue operatton todudes ttie steps of: 

1. k>cking BOQ, conditionally waiting for the 
queue to become available; 2. writing e nun Into 
link pointer of ttie additional QEL, "New-Blank*: 3. 

so writing ttie memory address of New-Blank into 
Linkage Pointer of OU-Blank; 4. toadlr^ a message 
into ttie fdmner Blank-QEL, 'OkJ- Blank*; S. putting 
memory address of New«lank into ttie BOQ poim- 
er word; and 6. untocMng BOa . 

68 The Qritfnal queue has not beeriattaredenoept 
for ttie contente of ttie original Blank-QQ. The 
or^nal Blank^<:£L was irtfttaOy at ttie bottom of ttie 
qu ue. Only the prooessor/hokter of tti TOQ tock 
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may altdr the queua^ noThbtank QEL8. 

Vm emtueutng piDcessor can add mora itian 
one QEL. In p wpaialto n for enqueuing, ttte addl* 
tional QEU ate to be finked one to anottier from 
Top-AddnMEL to Bot-Addnl-GB-. The steps are 
Ssted below in an order wtdch oontimiously main- 
tains a weD tamed <iu6ue. ^iote. a "well fomned 
queue" mtafe to a TOQ-BOQ pair and He asso- 
ciated queue confdmiing to the above delinHions. 

1. loddng BOO. pertiapa wailino for tt to be- 
come available; 

2. putBng miO btfo IM polntsr of Bol-AddnMBU 
maMng it NOW'uunx; 

3. loading messages Into Old-Blank, and an 
AddnMEU except New-Blank; 

4. putt^ memoiy addiess of Top-Addnl Mo 
McpoiMBr of Old Blank; 

& putting address of New-Blank Into BOO; and 
a unlocking BOa 

Refonrlng now to Rguros 4A^. there are de- 
pIctBd tvro eocamplas using a DEQUE operation In 
whtoh a ebigle QEL Is removed from the top of a 
queue. A processor copies into the TOO the oor^ 
fonts of the Onk pointer from the fM QEL in the 
queue. To remove a continuously finkad sequence 
off QELs. a processor changes the TOQ pointer, or 
a single QEL Drdc pointer, so as to point around the 
QELs being removed. The dequeue etsps are 1st- 
ed below fai an order which continuously mtfnt^ 
a weD formed queue. 

1. If TOQ B BOa odttng without tocUng as 
queue la empty of non-Hanks; 

2. tockkig TOa condittonaOy after waiting for H 
to become avdWe; 

a reading BOa any QEL at that address or 

linked beyond It Is IneiiM 

4w remo^ one or more eOgible QEU liom 

anywhere on the queue; and 

S. unkxMngTOQ. 

The QEL pofrited to by BOa when BOQ Is 
read. Is treated as IneligMe. WhQe a BOQ took 
holder may make this a vafid QEL and may change 
BOQ, the QEL will remain inefiglble for this execu- 
tion of enqueue or reorder. 

Raorderino Is a two step process In wWch 
QEL(s) are first dequeued from, and then reinsert 
ted into, the eligible QEL chain. The processor 
doing the reordering holds the TOQ kx:k for the 
duration of both steps. So to move a single QEU 
caDed "Movlng4IEL", to the top of the queue, a 
proces so r s dequeues the QEL. as defined pre- 
viously, and then r^nserts It by changing Movlng- 
QEL*s Onk pointer to the value In TOQ, and putting 
the address of Movlng<lEL into TOQ. 

bi a abnOar manner e processor can dequeue 
any number of eligible QBjs. link tiiem togetiier In 
one or more fragmentary chains, and tlien reinseft 
the fragments t>ack into the queu . fleinsertion can 



be done maintaining a weU fonmed queue ty: 
1. setting Ink polntar of fragment ra final QEL to 
addresa of QEL tiiat win fPOow fragmem In 
queue; and 

6 2. setting TOQ pointer, or Onk pointer of QEL 
that Is to precede firagment. to the address of 
ftst QEL In fragment- 

Fbr any operation to continuously maintain a 
wen fonned queue, each single word storage up- 

ro date of a pointer In shared memory must complete 
fuOy. If a process then fbUows the steps of an 
cpera tto n In ttie order given, the queue wlQ remain 
weO fomied. In the event of most hardware faSuies, 
or of 8 premature process termlnaBor^ some ki- 

16 transit QELs may not l)e on the queue, but the 
quaue Itself wOl remain weO formed. Ottier pro- 
cesses wiUiM eble to oonOwe woildng with euGh a 
queue. 

In the Inlttat example the anocation of shared 
20 nnemory can t>e a processor only fcmction. This can 
te achieved t»y tiaving the controtiere reuse each 
work queue element as the QEL In wtdch to report 
completion fi lAlk i s 

28 Claims 

1. A mettiod of passing task messages in a data 
processing system inducting a pturality of high- 
speed processor s (5. 7). an eodemal storage 
so subsystem (3). and shared internal memory 
(13). said method comprising the steps of: t v 

defMng a first inked Qst in the shared 
Internal memory witti separately tockaUe first 
as and second ends; and « > 

operating stfdnst as a queue of tadc mas- 
sagas passing t)etMreen the ttigthspeed proces- 
sors and the storage subsytem. locka!>ly en- 
40 queidng task messages at ttie first end of file 
queue and independentty tockably dequeuing 
task messages from the second end of the 
queue. 

45 Z A metiK)d as claimed In daim 1. in wfUch the 
task messages are enqueued at add first end 
of the queue by the high-speed processors, 
and dequeued from the second end of the 
quaue by the external storage subsystem. 

so 

& A mettwd as claimed In daim 2. hirther com- 
prising tfie steps of: 

defining a second Bnked tist in the shared 
65 intamal memory witti separately kKkable first 
and second ends; and 

operating sakt saoond Dst as a queue of 
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task mdssagos passti^ MwMn the Mglh 
spaed preoBMO W and iho stotagg guteygtam, 
task messages being tockably enqueued by 
the external storage subsystem at the first end 
of the queue, and Independently task mes> 
sages being tockably dequeued by the trigh 
speed processors from the second end of the 
queue. 

4. A method as claimed In daim 3, further com- 
prisirig the steps of: 

defin&ig rafefonce points and operator sets 
over said first and seoond lists, one rof^renoe 
point being associated with the second end of 
each list, and each operator est including top 
of 6st (TOO) and bottom of fist (BOO) pdnters. 
and top of 1st (TOQI4 and bottom of fist 
(EKKUL) tockwords; 

obttfning a first k>ck by one of the proces- 
sors on 8^ second end of the first list upon 
said one processor matching tfie BOQL em- 
bedding task messages between the reference 
point and the last message in fiie fist, and 
releasing saia nisc locic 

obtaining a second kxdc by the subsystem 
oneaMfirstendofthefirstfist iivxmi saM 
subsystem matching filieTOQl^ removing one 
or more task messages from said first fist, and 
releasing sakJ second lock. 

& A method as claimed In daim 4. Wherein only 
the hokfer of said second lock (TOOL) may 
alter any pointer to file non-iefaienoe point end 
of the fist or any of the task messages in the 
fist, and further wherein only the holder of file 
first kKk (BOQL) may atter any pointer des- 
ignating flie reference point end of the fist 

& A mettled as claimed In any prece(fing daim, 
wherein said method further co m prise s the 
step of: 

reonierfng the fist of task messages by 
obtaining a lock on the second end of the first 
list when availabte, removing task messages 
from anywhere on the fist, finking at least some 
of ifie dequeued task messages togefiier in 
one or more fragmentary chains, and then rsin- 
serfing the fragmentary chains back into the 
queue, and releasing th took. 

7. A mettiod as dabned in any of dafans 2 to ^ 
wherein the prooessor s originate task mes- 
sages in ttie form of control btocfcs (DOB'S) for 
the subsystem, each DOB speci^ ii ^ one or 



more access operattons to be exacutsd by 
said subsystem, said DCB*s bsing enqueued 
on ttie first flst tsy ttie oilgliming processors, 
and sakJ subsystem dequeuing and processing 
a each DCB firom sakJ first fist a ccor din g to 
eittier an external disdpfine (UFO, RLX). RFC) 
or aooorcfing to a priority rsordering of said 
first fist or portion tfiereof • 

10 a A mettiod as dalmed in daim 7, wherein each 
DCB assumes eittier a waiting, acfive. or com- 
pletad status, the waifing 006*8 constituting 
the first fist, active DOB's b^ng cunrentty pro- 
cessed, and completed DCB*s constituting ttie 

16 second fist 

a A mettiod as darned In daim 7 or a wherein 
ttie subsystem processes task messages de- 
queued from said first fist updates each task 

20 .message, and enqueues fiie updated task 
messages onto ttie second fist, said originatir^ 
processors <fequeuing and processing each 
updafiad task message from sakl second fist 
aocorcfing to dttisr an OKtamal di$c4>nne (UFO. 

25 RU), FIFO) or to a prtority reordering d said 
saoona use or pomon meraor. 

ia A date processing system induding a pturslity 
of Ifigh-speod pnxsessore C5. 7). an esdemal 
so storage subsystem (3). arid shared Memal 
rnemory (f 9, sM system lurttier Induding: 

means for ddlrfing fM and second Ohkad 
liste in ttie shared memory each wfih sspa- 
ss rstelykxJcable first and second ends; 

means for operating said first and second 
fiste as wait and completion queues d task 
messages respectively, tockably enqueuing 
40 task messages at the first end da queue and 
independently tockably dequeuing task mes- 
sages from ttie second end of ttie queue; 

means responshro to task messages origi- 
46 nating from processors for writing ttie task 
messages into ttie shared memory. Gnking said 
task messages into the wait queue, and signal- 
fing ttie storage subsystem accordingly; 

60 means at the storage subsystem 

apertodlcally rssponsWe to saM signalDng for 
dequedng ttie task messages from ttie wait 
queue, acttvely processing the dequeued task 
messages, enquedng the processed task mes- 
as sages onto ttie oomplefion <|ueue in said 
stiared memory, and s^namng ttie prooessor s 
aooordingfy; and 
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fneans aperfodicaily responsive to the 8ut>- 
systom stgnals for dequeuing the processed 
task messages from the compteton queue. 
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